Hadoop MapReduce v2 Cookbook Second Edition by 2015

Author:2015
Language: eng
Format: epub
Publisher: Packt Publishing

How it works...

You can find the source for this recipe from chapter5/src/chapter5/HitCountMapReduce.java.

As described in the earlier recipe, we will use a regular expression to parse the web server logs and to extract the requested URL paths. For example, /shuttle/countdown/countdown.html will get extracted from the following sample log entry:

205.212.115.106 - - [01/Jul/1995:00:00:12 -0400] "GET /shuttle/countdown/countdown.html HTTP/1.0" 200 3985

The following code segment shows the Mapper:

private final static IntWritable one = new IntWritable(1); private Text word = new Text(); public void map(Object key, Text value, Context context) …… { Matcher matcher = httplogPattern.matcher(value.toString()); if (matcher.matches()) { String linkUrl = matcher.group(4); word.set(linkUrl); context.write(word, one); } }

Download

Copyright Disclaimer:
This site does not store any files on its server. We only index and link to content provided by other sites. Please contact the content providers to delete copyright contents if any and email us, we'll remove relevant links or contents immediately.